refactor(profiling): split upload function#1733
refactor(profiling): split upload function#1733gh-worker-dd-mergequeue-cf854d[bot] merged 2 commits intomainfrom
Conversation
Clippy Allow Annotation ReportComparing clippy allow annotations between branches:
Summary by Rule
Annotation Counts by File
Annotation Stats by Crate
About This ReportThis report tracks Clippy allow annotations for specific rules, showing how they've changed in this PR. Decreasing the number of these annotations generally improves code quality. |
Codecov Report❌ Patch coverage is Additional details and impacted files@@ Coverage Diff @@
## main #1733 +/- ##
==========================================
- Coverage 71.60% 71.58% -0.02%
==========================================
Files 431 431
Lines 69147 69156 +9
==========================================
- Hits 49511 49504 -7
- Misses 19636 19652 +16
🚀 New features to boost your workflow:
|
c07829c to
7a18d4d
Compare
🎉 All green!❄️ No new flaky tests detected 🎯 Code Coverage (details) 🔗 Commit SHA: 74f1ea5 | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback! |
BenchmarksComparisonBenchmark execution time: 2026-03-31 09:46:30 Comparing candidate commit 6f118be in PR branch Found 7 performance improvements and 20 performance regressions! Performance is the same for 31 metrics, 1 unstable metrics.
|
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.214µs | 3.144µs ± 1.413µs | 2.970µs ± 0.030µs | 3.001µs | 3.326µs | 13.613µs | 14.987µs | 404.59% | 7.508 | 56.992 | 44.85% | 0.100µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [2.948µs; 3.340µs] or [-6.231%; +6.231%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | 4.176ms | 4.181ms ± 0.007ms | 4.181ms ± 0.002ms | 4.183ms | 4.185ms | 4.189ms | 4.267ms | 2.07% | 11.075 | 140.907 | 0.16% | 0.000ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | [4.181ms; 4.182ms] or [-0.022%; +0.022%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 90.191µs | 90.413µs ± 0.156µs | 90.388µs ± 0.063µs | 90.467µs | 90.574µs | 91.059µs | 91.683µs | 1.43% | 4.130 | 26.041 | 0.17% | 0.011µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [90.392µs; 90.435µs] or [-0.024%; +0.024%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.326µs | 2.383µs ± 0.018µs | 2.381µs ± 0.006µs | 2.388µs | 2.427µs | 2.435µs | 2.444µs | 2.63% | 0.433 | 3.137 | 0.76% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.380µs; 2.385µs] or [-0.106%; +0.106%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.896µs | 3.917µs ± 0.004µs | 3.916µs ± 0.002µs | 3.919µs | 3.923µs | 3.927µs | 3.932µs | 0.41% | 0.212 | 3.770 | 0.10% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 254346952.746op/s | 255327898.102op/s ± 264844.133op/s | 255394202.552op/s ± 160203.421op/s | 255513550.222op/s | 255634815.918op/s | 255697256.509op/s | 256689221.616op/s | 0.51% | -0.194 | 3.815 | 0.10% | 18727.308op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 78.901µs | 79.641µs ± 0.350µs | 79.609µs ± 0.226µs | 79.857µs | 80.255µs | 80.525µs | 80.794µs | 1.49% | 0.608 | 0.154 | 0.44% | 0.025µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12377132.403op/s | 12556632.296op/s ± 54964.775op/s | 12561376.281op/s ± 35526.182op/s | 12595454.932op/s | 12636675.107op/s | 12649086.469op/s | 12674120.793op/s | 0.90% | -0.585 | 0.112 | 0.44% | 3886.596op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 72.415µs | 73.114µs ± 0.382µs | 73.065µs ± 0.227µs | 73.350µs | 73.717µs | 74.164µs | 75.420µs | 3.22% | 1.479 | 6.180 | 0.52% | 0.027µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 13259063.223op/s | 13677553.812op/s ± 70895.863op/s | 13686414.205op/s ± 42646.785op/s | 13724553.914op/s | 13778114.684op/s | 13792957.738op/s | 13809388.308op/s | 0.90% | -1.388 | 5.585 | 0.52% | 5013.095op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.895µs | 3.916µs ± 0.004µs | 3.916µs ± 0.002µs | 3.919µs | 3.923µs | 3.926µs | 3.927µs | 0.30% | -0.108 | 3.628 | 0.10% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254624633.622op/s | 255345375.078op/s ± 254006.512op/s | 255393665.654op/s ± 162719.399op/s | 255526933.556op/s | 255626319.782op/s | 255703999.036op/s | 256725777.953op/s | 0.52% | 0.124 | 3.702 | 0.10% | 17960.973op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 69.165µs | 69.710µs ± 0.327µs | 69.620µs ± 0.221µs | 69.942µs | 70.263µs | 70.559µs | 71.039µs | 2.04% | 0.902 | 0.734 | 0.47% | 0.023µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 14076861.423op/s | 14345449.303op/s ± 67104.515op/s | 14363609.812op/s ± 45381.176op/s | 14394636.200op/s | 14430685.844op/s | 14450941.129op/s | 14458143.424op/s | 0.66% | -0.875 | 0.641 | 0.47% | 4745.006op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 52.198µs | 52.278µs ± 0.053µs | 52.265µs ± 0.034µs | 52.312µs | 52.366µs | 52.436µs | 52.486µs | 0.42% | 1.197 | 1.738 | 0.10% | 0.004µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 19052624.142op/s | 19128500.044op/s ± 19231.821op/s | 19133349.945op/s ± 12560.942op/s | 19144008.084op/s | 19149414.715op/s | 19152543.740op/s | 19157732.295op/s | 0.13% | -1.191 | 1.710 | 0.10% | 1359.895op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.032µs | 6.043µs ± 0.008µs | 6.042µs ± 0.004µs | 6.046µs | 6.053µs | 6.080µs | 6.099µs | 0.94% | 2.953 | 12.954 | 0.14% | 0.001µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 163974008.683op/s | 165479741.489op/s ± 230880.528op/s | 165519564.428op/s ± 109717.509op/s | 165626588.403op/s | 165695296.765op/s | 165731230.533op/s | 165780567.032op/s | 0.16% | -2.927 | 12.750 | 0.14% | 16325.719op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.903µs | 3.916µs ± 0.003µs | 3.916µs ± 0.003µs | 3.918µs | 3.922µs | 3.925µs | 3.925µs | 0.25% | 0.275 | 0.571 | 0.09% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 254751875.864op/s | 255356993.675op/s ± 222016.049op/s | 255381747.741op/s ± 166959.909op/s | 255546250.756op/s | 255622904.172op/s | 255671920.893op/s | 256241868.235op/s | 0.34% | -0.268 | 0.581 | 0.09% | 15698.905op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 64.203µs | 64.510µs ± 0.142µs | 64.503µs ± 0.093µs | 64.599µs | 64.738µs | 64.907µs | 65.077µs | 0.89% | 0.592 | 1.090 | 0.22% | 0.010µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15366319.765op/s | 15501604.186op/s ± 34194.246op/s | 15503116.375op/s ± 22478.763op/s | 15525374.571op/s | 15553438.548op/s | 15566850.817op/s | 15575636.589op/s | 0.47% | -0.574 | 1.046 | 0.22% | 2417.898op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 58.146µs | 58.387µs ± 0.148µs | 58.350µs ± 0.085µs | 58.452µs | 58.693µs | 58.770µs | 59.108µs | 1.30% | 1.196 | 2.101 | 0.25% | 0.010µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 16918180.336op/s | 17127105.659op/s ± 43408.362op/s | 17137938.384op/s ± 25013.670op/s | 17159287.874op/s | 17181169.353op/s | 17192662.987op/s | 17198032.545op/s | 0.35% | -1.175 | 2.002 | 0.25% | 3069.435op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.899µs | 3.916µs ± 0.004µs | 3.916µs ± 0.003µs | 3.918µs | 3.923µs | 3.925µs | 3.930µs | 0.35% | 0.284 | 2.334 | 0.09% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254448515.222op/s | 255330845.614op/s ± 242532.230op/s | 255344296.643op/s ± 167745.397op/s | 255515314.063op/s | 255622445.215op/s | 255672766.798op/s | 256450008.917op/s | 0.43% | -0.271 | 2.353 | 0.09% | 17149.618op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 54.609µs | 54.960µs ± 0.256µs | 54.895µs ± 0.164µs | 55.115µs | 55.400µs | 55.785µs | 55.830µs | 1.70% | 1.088 | 0.999 | 0.46% | 0.018µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 17911390.188op/s | 18195377.570op/s ± 84397.579op/s | 18216590.762op/s ± 54559.415op/s | 18262727.474op/s | 18293684.801op/s | 18301515.634op/s | 18312158.307op/s | 0.52% | -1.063 | 0.913 | 0.46% | 5967.810op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 52.191µs | 52.276µs ± 0.049µs | 52.272µs ± 0.032µs | 52.306µs | 52.358µs | 52.416µs | 52.448µs | 0.34% | 0.733 | 0.729 | 0.09% | 0.003µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 19066628.931op/s | 19129406.200op/s ± 17926.536op/s | 19130717.151op/s ± 11892.348op/s | 19142090.395op/s | 19155627.139op/s | 19158560.608op/s | 19160575.200op/s | 0.16% | -0.727 | 0.713 | 0.09% | 1267.598op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.032µs | 6.043µs ± 0.009µs | 6.041µs ± 0.004µs | 6.045µs | 6.054µs | 6.082µs | 6.105µs | 1.07% | 3.250 | 14.231 | 0.16% | 0.001µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 163801914.691op/s | 165493815.531op/s ± 256521.843op/s | 165548439.485op/s ± 108039.625op/s | 165648910.090op/s | 165726731.573op/s | 165756535.257op/s | 165769923.166op/s | 0.13% | -3.223 | 14.017 | 0.15% | 18138.833op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.916µs; 3.917µs] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255291193.252op/s; 255364602.952op/s] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [79.592µs; 79.689µs] or [-0.061%; +0.061%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12549014.707op/s; 12564249.885op/s] or [-0.061%; +0.061%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [73.062µs; 73.167µs] or [-0.072%; +0.072%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [13667728.328op/s; 13687379.297op/s] or [-0.072%; +0.072%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.916µs; 3.917µs] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255310172.219op/s; 255380577.938op/s] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [69.665µs; 69.755µs] or [-0.065%; +0.065%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [14336149.263op/s; 14354749.344op/s] or [-0.065%; +0.065%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [52.271µs; 52.285µs] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [19125834.698op/s; 19131165.389op/s] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.042µs; 6.044µs] or [-0.019%; +0.019%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [165447743.668op/s; 165511739.309op/s] or [-0.019%; +0.019%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.916µs; 3.917µs] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255326224.386op/s; 255387762.964op/s] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [64.490µs; 64.530µs] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15496865.193op/s; 15506343.180op/s] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [58.367µs; 58.408µs] or [-0.035%; +0.035%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [17121089.678op/s; 17133121.641op/s] or [-0.035%; +0.035%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.916µs; 3.917µs] or [-0.013%; +0.013%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255297232.979op/s; 255364458.248op/s] or [-0.013%; +0.013%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [54.925µs; 54.996µs] or [-0.065%; +0.065%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [18183680.877op/s; 18207074.263op/s] or [-0.064%; +0.064%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [52.269µs; 52.282µs] or [-0.013%; +0.013%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [19126921.754op/s; 19131890.645op/s] or [-0.013%; +0.013%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.041µs; 6.044µs] or [-0.022%; +0.022%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [165458264.070op/s; 165529366.991op/s] or [-0.021%; +0.021%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 187.359ns | 190.474ns ± 2.485ns | 190.069ns ± 1.359ns | 191.283ns | 194.508ns | 201.394ns | 203.955ns | 7.31% | 2.363 | 8.770 | 1.30% | 0.176ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [190.130ns; 190.818ns] or [-0.181%; +0.181%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 534.329µs | 535.382µs ± 0.910µs | 535.134µs ± 0.407µs | 535.729µs | 537.342µs | 538.415µs | 541.114µs | 1.12% | 2.501 | 9.314 | 0.17% | 0.064µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1848039.817op/s | 1867832.298op/s ± 3162.676op/s | 1868691.141op/s ± 1422.123op/s | 1869844.831op/s | 1870895.211op/s | 1871253.775op/s | 1871506.956op/s | 0.15% | -2.475 | 9.114 | 0.17% | 223.635op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 400.439µs | 401.345µs ± 0.433µs | 401.281µs ± 0.245µs | 401.575µs | 402.136µs | 402.660µs | 403.476µs | 0.55% | 1.248 | 2.935 | 0.11% | 0.031µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2478459.092op/s | 2491623.133op/s ± 2683.433op/s | 2492019.873op/s ± 1521.854op/s | 2493356.056op/s | 2495177.743op/s | 2496019.598op/s | 2497261.526op/s | 0.21% | -1.238 | 2.886 | 0.11% | 189.747op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 189.510µs | 190.029µs ± 0.273µs | 189.970µs ± 0.155µs | 190.189µs | 190.557µs | 190.779µs | 191.019µs | 0.55% | 0.986 | 1.237 | 0.14% | 0.019µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5235067.975op/s | 5262368.070op/s ± 7538.599op/s | 5263991.895op/s ± 4286.991op/s | 5267433.153op/s | 5271925.837op/s | 5275379.996op/s | 5276779.963op/s | 0.24% | -0.976 | 1.210 | 0.14% | 533.059op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 37.341µs | 37.543µs ± 0.077µs | 37.543µs ± 0.048µs | 37.590µs | 37.679µs | 37.709µs | 37.843µs | 0.80% | 0.305 | 0.486 | 0.20% | 0.005µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26425240.635op/s | 26636526.536op/s ± 54364.170op/s | 26636307.618op/s ± 34245.330op/s | 26671167.955op/s | 26720577.130op/s | 26751262.266op/s | 26779984.257op/s | 0.54% | -0.290 | 0.460 | 0.20% | 3844.127op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 45.777µs | 45.937µs ± 0.122µs | 45.915µs ± 0.056µs | 45.980µs | 46.091µs | 46.153µs | 47.165µs | 2.72% | 5.339 | 50.042 | 0.26% | 0.009µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 21201987.804op/s | 21769067.716op/s ± 56893.460op/s | 21779298.518op/s ± 26404.187op/s | 21799707.582op/s | 21824611.483op/s | 21839060.861op/s | 21845031.348op/s | 0.30% | -5.156 | 47.549 | 0.26% | 4022.975op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [535.255µs; 535.508µs] or [-0.024%; +0.024%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1867393.982op/s; 1868270.615op/s] or [-0.023%; +0.023%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [401.285µs; 401.405µs] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2491251.235op/s; 2491995.031op/s] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [189.991µs; 190.067µs] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5261323.293op/s; 5263412.848op/s] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.532µs; 37.553µs] or [-0.028%; +0.028%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26628992.185op/s; 26644060.887op/s] or [-0.028%; +0.028%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [45.920µs; 45.954µs] or [-0.037%; +0.037%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [21761182.829op/s; 21776952.602op/s] or [-0.036%; +0.036%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2597 | execution_time | 3.295ms | 3.318ms ± 0.014ms | 3.316ms ± 0.007ms | 3.324ms | 3.348ms | 3.358ms | 3.380ms | 1.92% | 1.294 | 2.498 | 0.41% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2597 | execution_time | [3.316ms; 3.320ms] or [-0.057%; +0.057%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | 735.025µs | 736.330µs ± 0.656µs | 736.248µs ± 0.345µs | 736.606µs | 737.358µs | 738.010µs | 740.773µs | 0.61% | 1.962 | 9.729 | 0.09% | 0.046µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | [736.239µs; 736.421µs] or [-0.012%; +0.012%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 18.788µs | 27.776µs ± 10.698µs | 19.558µs ± 0.640µs | 37.202µs | 47.208µs | 48.000µs | 77.738µs | 297.47% | 0.961 | 0.787 | 38.42% | 0.756µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [26.294µs; 29.259µs] or [-5.338%; +5.338%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 10.757ms | 10.788ms ± 0.015ms | 10.787ms ± 0.010ms | 10.797ms | 10.811ms | 10.830ms | 10.862ms | 0.70% | 1.198 | 3.349 | 0.14% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [10.786ms; 10.790ms] or [-0.020%; +0.020%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 161.181µs | 162.147µs ± 0.377µs | 162.092µs ± 0.154µs | 162.282µs | 162.647µs | 163.868µs | 164.493µs | 1.48% | 2.587 | 12.415 | 0.23% | 0.027µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [162.094µs; 162.199µs] or [-0.032%; +0.032%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 13.947ms | 14.010ms ± 0.024ms | 14.008ms ± 0.014ms | 14.023ms | 14.046ms | 14.084ms | 14.168ms | 1.14% | 1.654 | 8.594 | 0.17% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.007ms; 14.013ms] or [-0.024%; +0.024%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.938µs | 4.993µs ± 0.036µs | 4.973µs ± 0.014µs | 5.031µs | 5.055µs | 5.059µs | 5.090µs | 2.35% | 0.622 | -1.159 | 0.72% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [4.988µs; 4.998µs] or [-0.101%; +0.101%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 239.924ns | 250.414ns ± 11.965ns | 244.075ns ± 2.443ns | 253.179ns | 278.606ns | 284.187ns | 284.543ns | 16.58% | 1.457 | 0.888 | 4.77% | 0.846ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [248.756ns; 252.073ns] or [-0.662%; +0.662%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 145.106µs | 147.261µs ± 1.938µs | 146.997µs ± 0.563µs | 147.587µs | 148.735µs | 156.537µs | 167.081µs | 13.66% | 6.601 | 58.102 | 1.31% | 0.137µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [146.992µs; 147.529µs] or [-0.182%; +0.182%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 49.740ms | 50.152ms ± 0.909ms | 50.025ms ± 0.065ms | 50.095ms | 50.205ms | 54.976ms | 58.368ms | 16.68% | 7.913 | 64.557 | 1.81% | 0.064ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [50.026ms; 50.278ms] or [-0.251%; +0.251%] | None | None | None |
Group 18
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 185.592µs | 186.111µs ± 0.271µs | 186.099µs ± 0.207µs | 186.297µs | 186.562µs | 186.676µs | 187.039µs | 0.51% | 0.354 | -0.437 | 0.15% | 0.019µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 5346470.681op/s | 5373150.490op/s ± 7822.356op/s | 5373478.954op/s ± 5980.220op/s | 5379681.079op/s | 5384118.348op/s | 5386218.610op/s | 5388161.831op/s | 0.27% | -0.348 | -0.449 | 0.15% | 553.124op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 17.876µs | 17.970µs ± 0.054µs | 17.961µs ± 0.024µs | 17.989µs | 18.082µs | 18.161µs | 18.227µs | 1.48% | 1.682 | 4.246 | 0.30% | 0.004µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 54862879.683op/s | 55648881.273op/s ± 167924.066op/s | 55676851.554op/s ± 74426.329op/s | 55745133.251op/s | 55867241.032op/s | 55913093.206op/s | 55940900.084op/s | 0.47% | -1.652 | 4.112 | 0.30% | 11874.025op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.326µs | 10.484µs ± 0.058µs | 10.486µs ± 0.034µs | 10.519µs | 10.579µs | 10.624µs | 10.677µs | 1.82% | 0.130 | 0.485 | 0.55% | 0.004µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 93658464.044op/s | 95382854.491op/s ± 528276.878op/s | 95365179.498op/s ± 309662.720op/s | 95685428.069op/s | 96296952.625op/s | 96513590.706op/s | 96844853.805op/s | 1.55% | -0.089 | 0.449 | 0.55% | 37354.816op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [186.073µs; 186.149µs] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [5372066.386op/s; 5374234.593op/s] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [17.962µs; 17.978µs] or [-0.042%; +0.042%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [55625608.613op/s; 55672153.934op/s] or [-0.042%; +0.042%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.476µs; 10.492µs] or [-0.077%; +0.077%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [95309640.397op/s; 95456068.586op/s] or [-0.077%; +0.077%] | None | None | None |
Group 19
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6f118be | 1774949326 | kowalski/temp-profiling-split-upload-function |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 33.494µs | 34.104µs ± 0.899µs | 33.710µs ± 0.103µs | 33.882µs | 36.000µs | 36.077µs | 37.341µs | 10.77% | 1.707 | 1.197 | 2.63% | 0.064µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [33.979µs; 34.228µs] or [-0.366%; +0.366%] | None | None | None |
Baseline
Omitted due to size.
Artifact Size Benchmark Reportaarch64-alpine-linux-musl
aarch64-unknown-linux-gnu
libdatadog-x64-windows
libdatadog-x86-windows
x86_64-alpine-linux-musl
x86_64-unknown-linux-gnu
|
7a18d4d to
0ba86f7
Compare
1e58e48 to
cdb4861
Compare
cdb4861 to
6f118be
Compare
# What does this PR do? This PR fixes an unused variable (`c`) which happens when the code is compiled with `NDEBUG` (which I think I accidentally did when I ran FFI tests for #1733). To work around this, I extracted the `c.load` from the `assert` and then always do `std::ignore = value` so that everything is always used. Co-authored-by: thomas.kowalski <thomas.kowalski@datadoghq.com>
1394424 to
f6ff9e9
Compare
f6ff9e9 to
74f1ea5
Compare
What does this PR do?
This PR splits the Exporter creation process into two steps (two functions to call):
init_runtimesend_blocking(send_blockingcallsinit_runtimeif it hasn't been initialised from the outside)This fixes a TSan-detected race condition where we try to cancel the Upload request (using the Cancellation Token) at the same time the runtime is being initialised.
Example runtime Profiler fix PR: DataDog/dd-trace-py#16467
The PR also updates the existing
exporter.cppexample to use the new function (tested withcargo ffi-test --filter exporter).Open questions
Currently, the PR maintains compatibility with existing usages -- not explicitly calling
init_runtimewill makesend_blockingcall it when it needs it. However, this is risky (for the reasons that made us make this PR in the first place).--- We ended up going for the second, keeping the race so that we don't have a breaking API change.